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(54) Throe dimensional animation system and method 



(57) A system and method for three dimensional 
character animation provides a rapid download of the 
animated character since the persistent data of the ani- 
mated character may be downloaded initially to begin 
the animation. One or more behavior files may then be 
downloaded as needed which reduces the initial down- 
load time of a character. The system may store the per- 



sistent data in a character cache. To reduce the size of 
the behavior files, the persistent data may include 
morphlinks, for each polygon on the character, that 
determine the contributions that the movement of each 
joint in the character make on each polygon of the char- 
acter. 



50 
42 



52 



3-D 
M00ELS 



2^ 



TEXTURE 



40 



SERVER 



44 



5 8 X CREAT0R 

I PERSISTENT | 
6CW 

| BEHAVIOR 



WEB 



62 



CHARACTER & 
BEHAVIOR 
STORE , 



64 



PLAYER 



Z 



66 



JSER INTERFACE 
APPLICATION 



SOUNDS I | BEHAVIORS I ( uk 
OISPUY 



HTTP 



48 




Figure 1 



Printed by Xerox (UK) Business Services 
2.16.7 (HRS)/3.6 



1 



EP 1 059 614 A2 



2 



Description « ■ 

Background of the Invention 

[0001] This invention relates generally to a system 
and method for animating a computer image on a com- 
puter display and in particular to a system and method 
for generating realistic three-dimensional animation of 
an object over a tow bandwidth communications net- 
work. 

[0002] There are many different techniques for gen- 
erating an animation of a three dimensional object on a 
computer display. Originally, the animated figures 
looked very much like stick figures or block figures since 
the animation was not very good. In particular, the user 
would see a block representing the arm move relative to 
a block representing the forearm. The problem was that 
there was no skin covering the blocks so that the figure 
looked unrealistic and not very life-like. More recently, 
the figures for animation have improved so that a skin 
may cover the bones of the figure to provide a more 
realistic animated figure. 

[0003] Some techniques and systems, such as 
those used to generate three dimensional animation for 
a movie, are very high-end and expensive. In addition, 
these high-end three dimensional animations may be 
viewed by a consumer on a movie screen, for example, 
but cannot be interacted with in any way In particular, 
the consumer may view the three dimensional anima- 
tions which tell a story such as in a movie but the con- 
sumer cannot interact with the animations in any 
manner. These high-end animation systems are very 
useful for a movie, but cannot be readily used by the 
general public due to the costs of the system. 
[0004] Other animation systems, such as dedicated 
game playing systems or personal computers executing 
a software application, permit the user to interact with 
the animations. These systems, however, require a 
large amount of memory for storing the animation data 
and a fairly state-of-the-art processor or graphics 
coprocessor in order to produce realistic three dimen- 
sional animation. The problem with a dedicated game 
playing system is that it cannot be used for other com- 
puting related tasks and therefore are relatively expen- 
sive due to the limited functions that they perform. The 
problem with most personal computers is that the per- 
sonal computer is not optimized to produce the anima- 
tions and therefore usually requires an expensive 
graphics co-processor and a sound board. In the above 
conventional animation systems, the user may internet 
with the animation during the game play, but the entire 
game with the graphics and animation are stored on a 
cartridge or on a hard disk or CD of the personal com- 
puter. 

[0005] Recently, a number of animation systems 
have been introduced which harness the Internet or the 
World Wide Web (the Web) to communicate the anima- 
tion data to the user. In particular, the user may use a 



personal computer which is executing a browser soft- 
ware application. The user may direct the browser appli- 
cation to a particular uniform resource locator (URL) of 
a web site which then may download the animation data 

5 from the web site. The problem is that the web site typi- 
cally downloads the entire animation data so that the 
amount of animation data downloaded is large. An 
example of this type of animation system uses the vir- 
tual reality markup language (VRML) protocol. For a 

to user with a slow communications link, such as the Inter- 
net or the Web and a modem, the large amount of ani- 
mation data leads to a very slow download. The slow 
downloading time in turn leads to the consumer waiting 
a long period of time before viewing the animation. This 

75 long period of waiting before the animation is not 
acceptable since people become bored during the wait- 
ing period, cancel the animation and thus never see the 
animation displayed. It is desirable, however, to provide 
a three dimensional animation system in which the ani- 

20 mation data which may be downloaded rapidly over a 
very slow communications link and it is to this end that 
the present Invention is directed. 

Summary of the Invention . 

25 

[0006] The invention provides a three dimensional 
animation system and method in which the animation 
data may be downloaded over a relative slow communi- 
cations link, such as the Internet or Web and a modem, 

30 to a local computer in a relatively short amount of time. 
The local computer may then execute a downloaded 
software application to animate the object. The user of 
the local computer may interact with the animated 
object (i.e., change its behaviors or actions). In a pre- 

35 ferred embodiment, the main portion of the system may 
reside as a plurality of software applications on a web 
server and a client computer may access the web 
server to download the animations. To accomplish the 
shorter download time, the system may generate an ini- 

40 tial animation download package containing the data 
about the actual object (e.g., the persistent data) and a 
few basic actions of the object (e.g., behavior data). For 
example, each downloaded object may have an idle 
behavior associated with it which is executed any time 

45 that the object is not executed another behavior. Then, 
as additional actions or behaviors or sound tracks for 
the object are required, the system may stream the 
behavior data down to the client computer before the 
action is required so that the behaviors are asynchro- 

50 nously downloaded (i.e., the behaviors for the three 
dimensional animated object do not need to be down- 
loaded at the same time as the three dimensional ani- 
mated object is downloaded). In this manner, the client 
computer may more quickly begin the animation while 

55 other yet unneeded actions or behaviors are being 
downloaded. For example, as the animated object 
moves through a landscape, the object may cross a 
bounding box which causes an action that will be 
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needed shortly'to be downloaded to the client computer 
so that the action is available when needed. The one or 
more behavior or action files for a particular object may 
contain information about the movements of the joints in 
the object which correspond to a particular behavior 
and any other data necessary to execute the behavior. 
For example, a head nod behavior may involve the 
movement of the neck joint As another example, a 
sound track for the object, such as saying "Hello", may 
involve the movement of the various pieces of the lips 
and a sound track synchronized to the movement of the 
Hps. 

[0007] In accordance with the invention, the total 
size of each behavior downloaded to the client compu- 
ter is also relatively small in size so that the download 
time of the behavior, over a relatively slow communica- 
tions link, is not too slow. To reduce the size of each 
behavior, the initial object downloaded to the client com- 
puter may include an object tree containing data about 
each portion of the object For example, a person would 
include a leg object Then, each piece of skin on the 
object (e.g., each polygon) may include a contribution 
chart which lists each joint in the object, such as the 
knee or ankle, and the contributions that the movement 
of each joint makes to movement of the particularpoly- 
gon. For example, a polygon near the knee joint would 
probably be mostly influenced by knee movement while 
a polygon midway between the knee and ankle would 
be influenced by the movement of both the ankle and 
the knee. Thus, when a behavior commands the knee of 
the object to move, the client computer may easily 
determine the movement for each particular polygon 
based on the model of the object and the movement of 
the joints. Thus, for any downloaded behavior, only the 
movements of the joints in the object need to be speci- 
fied in the downloaded behavior file since the movement 
of each piece of skin on the model may be determined 
by the model based on the movement of the joints. 
Thus, if the model has twelve joints and 6000 polygons, 
the downloaded behavior file may contain data about 
the movement of the twelve joints whereas the behavior 
may cause the 6000 polygons on the model to move. 
[0008] In accordance with the invention, the system 
also permits a downloaded behavior to be streamed to 
the player application residing on the user's computer. 
In particular, the behavior may start playing on the 
player application before the entire behavior is down- 
loaded. For example, if a behavior is five minutes long, 
the user of the player application is not likely to wait 5 
minutes for the behavior to be downloaded. Therefore, 
in accordance with the invention the system downloads 
a predetermined amount of the behavior(e.g., a two 
second portion of the behavior data) at a time so that 
the behavior may start executing the first predetermined 
portion of the behavior data while the second and sub- 
sequent portions of the behavior data are downloaded. 
Thus, a long behavior being downloaded to the player 
application does not prevent the animated character's 
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behavior from being started. 

[0009] The system may also permit the user to 
interact with the animated objects in various different 
ways using actions and scripts which include one or 

5 more actions or behaviors. For each interaction with the 
object, there may be an action or behavior associated 
with that interaction. For example, when the user clicks 
on an animated door being displayed to the user, a 
behavior to open the door and show the door slowly 

10 opening with a creaking soundtrack may be down- 
loaded to the client computer and executed. On the cli- 
ent computer, the user may see the door slowly open 
and hear the door creak as it opens. As another exam- 
ple, when the user drags a cursor over an object, such 

15 as a gray knife, a behavior to turn the knife red will be 
downloaded and executed so that the knife turns red 
when the user places the cursor over it. When the user 
moves the cursor off of the knife, the knife returns to its 
idle behavior which is having a gray color. 

20 [0010] To shade the animated object using a light- 
ing model, the invention may use a spherical environ- 
mental map. In particular, the pixels resulting from a 
particular lighting condition is determined for a half- 
sphere and then the corresponding lighting for an object 

25 is determined based on the pixels in the half-sphere. 
The lighting model for the half-sphere may be down- 
loaded to the client computer so that, for each pixel of 
the object, the client computer may look up the corre- 
sponding point on the half-sphere and apply the pixel 

30 value on that portion of the half-sphere to the object. 
Thus, in accordance with the invention, the system does 
not attempt to calculate, in real-time, the lighting for an 
object. The system may also provide a character cache 
in the client computer that permits the character data to 

35 be stored in the client computer so that it does not need 
to be constantly refreshed. In contrast, in a conventional 
Web based 3-D system, such as VRML, the character 
may be stored in the cache of the browser application 
which is periodically flushed. 

40 [0011] Thus, in accordance with the invention, a 
system for animating a character on a computer is pro- 
vided, comprising a first computer and a second com- 
puter connected to the first computer. The first computer 
may store one or more pieces of data associated with a 

45 particular animated character. The pieces of data may 
include a persistent data file containing one or more of 
a geometric model of the animated character, a texture 
associated with the animated character and a sound 
associated with the animated character. The pieces of 

so data may further comprise one or more behavior files 
wherein each behavior file contains data about a partic- 
ular behavior of the animated character arid each 
behavior specifies the movement of the model. The sec- 
ond computer may initially download the persistent data 

55 file from the first computer in order to begin the anima- 
tion of the animated character on the second computer 
and then asynchronously download a behavior file from 
the first computer just prior to the execution of the 
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behavior'of the Animated character by the second com- 
puter. 

Brief Description of the Drawings 
[0012] 

Figure 1 is a block diagram illustrating the three 
dimensional animation system in accordance with 
the invention; 

Figure 2 is a flowchart illustrating a method for 
downloading three dimensional character files in 
accordance with the invention; 

Figure 3 is a diagram illustrating an example of an 
object hierarchy in accordance with the invention; 

Figures 4A and 4B are diagrams illustrating an 
example of a three dimensional object in accord- 
ance with the invention; 

Figure 5 is a diagram illustrating an articulation of a 

joint;. 

Figure 6 is a diagram illustrating a morphlink in 
accordance with the invention; 

Figure 7 is a diagram illustrating an example of the 
area of influence of a joint in accordance with the 
invention; 

Figures 8A and 8B are diagrams illustrating an 
example of the bones within a model in accordance 
with the invention; 

Figures 9 and 10 are diagrams illustrating an exam- 
ple of a model with the bones and polygons in 
accordance with the invention; 

Figure 1 1 is a diagram illustrating an example of a 
rendered, unlighted model in accordance with the 
invention; 

Figure 12 is a diagram illustrating an example of a 
rendered, lighted model in accordance with the 
invention; 

Figure 13 is a diagram illustrating an example of an 
environmental map lighting model in accordance 
with the invention; 

Figure 14 is a diagram illustrating an example of the 
rendered model shown in Figures 1 1 and 12; 

Figures 15 and 16 are diagrams illustrating the 
bones in a leg model in accordance with the inven- 
tion; 



Figure 1 7 is a diagram illustrating the leg of Figures 
15 and 16 showing the area of influence for each 
joint; 

5 Figure 18 is a diagram illustrating an example of a 

behavior in accordance with the invention; 

Figures 19A, 19B and 19C are diagrams illustrating 
another example of a behavior in accordance with 
10 the invention; 

Figure 20 is a flowchart illustrating a method for 
streaming behaviors in accordance with the inven- 
tion; 

15 

Figure 21 is a diagram illustrating the details of the 
streaming behaviors in accordance with the inven- 
tion; 

20 Figure 22 is a diagram illustrating more details of 
the streaming behavior shown in Figure 21; 

Figure 23 is a diagram illustrating a portion of a 
streamed behavior in accordance with the inven- 
25 tion; and 

Figures 24 and 25 are flowcharts illustrating the 
operation of the player in accordance with the 
invention. 

30 

Detailed Description of a Preferred Embodiment 

[0013] The invention is particularly applicable to a 
Web-based three dimensional animation system and 

35 method and it is in this context that the invention will be 
described. It will be appreciated, however, that the sys- 
tem and method in accordance with the invention has 
greater utility, such as to other types of three dimen- 
sional animation systems including stand-alone compu- 

40 ter systems and the like. 

[0014] Figure 1 is a block diagram illustrating a 
three dimensional animation system 40 in accordance 
with the invention. The system 40 may include a charac- 
ter creator 42, a server 44 and one or more client com- 

45 puters (CLIENT #1 - CLIENT #N) 46. In this example, 
the client computers may be connected to the server by 
a communications network 48 that may include various 
communication or computer networks such as the Inter- 
net, the World Wide Web (the Web), a local area net- 

50 work, a wide area network or other similar 
communications networks which connect computer sys- 
tems together. The creator 42 may be used to generate 
a three dimensional animated character as described 
below. In a preferred embodiment, the creator 42 may 

55 be a software application being executed by a computer 
system. The creator 42 may be stored on the server 44 
or may be executed by a separate computer system as 
shown in Figure 1 . The creator 42 may generate one or 
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more web files, as described below, which may be 
downloaded to the server 44 so that each client compu- 
ter may then download the web files from the server. 
Each client computer may then interpret the down- 
loaded web files and generate a three dimensional ani- 5 
mation based on the web files as described in more 
detail below. Now, each portion of the system 40 will be 
described in more detail. 

[0015] The creator 42 may accept various informa- 
tion from either user input or other external files in order 10 
to generate a three dimensional realistic object or char- 
acter which may be animated using the system. For 
example, the creator may receive three dimensional 
models 50 which may be, for example, wire frame mod- 
els of an object generated by a third party modeling sys- 15 
tern. The generation of a three dimensional wire frame 
model from a three dimensional object in well known 
and therefore will not be described here. The creator 42 
may also receive texture map information 52 which may 
be used to place a texture over the polygons painted 20 
onto the three dimensional object The texture may pro- 
vide, for example, a realistic flesh color and texture for 
the skin of a human character or a realistic set of teeth. 
The creator 42 may also receive a sound file 54 so that 
a sound track may be incorporated into a behavior file in 25 
accordance with the invention. The sound file may be 
generated by a third party system which receives a 
sound and generates a digital representation of the 
sound which may be incorporated into a file. The creator 
may also receive a behavior file 56. The behavior file 30 
may be combined with any sound file to generate a 
behavior for a three dimensional animation in accord- 
ance with the invention. The behavior file may be gener- 
ated by the user using a separate software module of 
the creator 42. The creator 42 may combine the three 35 
dimensional model information, the texture information, 
the sound file and the behavior file into one or more web 
files which are stored on the server. 
[0016] In accordance with the invention, the creator 
42 may generate more than one file for each animated 40 
object In particular, the creator may generate a file con- 
taining persistent data 58 and ten one or more files con- 
taining behavior data 60. The persistent data file may be 
initially downloaded to the client computer to begin the 
animation of the object and may include one or more of 45 
the three dimensional object (including joints and poly- 
gons), any textures, any morphlinks as described below, 
and an idle behavior for the three dimensional object. 
The idle behavior may be the* action or movement of the 
animated object when no other behavior is being exe- so 
cuted. For example, the idle behavior for an animated 
monster may be that the monster may breath which 
causes his chest to expand and contract. 
[0017] The persistent data file may also include the 
morphlink data associated with each polygon in the 55 
model in accordance with the invention. The model may 
include one or more joints connected together by one or 
more bones and a skin of polygons which cover the 



bones and joints. For each polygon on the model, the 
morphlink data permits the client computer to easily 
determine the movement of the polygons based on the 
movement of the joints of the object In a conventional 
animation system, the movement of each polygon must 
be independently calculated which is very slow. When a 
model is generated, the user of the creator defines the 
morphlinks so that the movement of a particular poly- 
gon based on the movement of the joints is determined 
by the user. Thus, the movement of each polygon rela- 
tive to movement of the joints of the model is defined in 
the persistent data. Therefore, when a behavior of the 
three dimensional animation is executed, the behavior 
may contain only information about the movement of 
each joint in the model and the client computer, based 
on the morphlinks, may determine the movement of 
each polygon on the model. Thus, the size of the behav- 
ior file downloaded to each client computer in accord- 
ance with the invention is reduced which speeds up the 
download speed of each behavior. In addition, the 
speed with which the three dimensional animation may 
be animated is increased since the client computer 
does not need to calculate the movement of each poly- 
gon on the three dimensional object or character each 
time a behavior occurs. The persistent data file 58 may 
also be compressed to further reduce the size of the 
persistent data. As an example, due to the compression 
and the structure of the persistent storage file in accord- 
ance with the invention, a persistent storage file maybe 
approximately 10- 200 Kb depending on the complexity 
of the three dimensional animation whereas a typical 
animation file may be approximately 1 Mb. 
[001 8] The one or more behavior files 60 may each 
contain a data structure which contains data specifying 
the movement of each joint in the three dimensional 
object or character during a behavior and any sound file 
which is associated with the particular behavior. In 
accordance with the invention, each different behavior 
of the three dimensional animation, such as smiling, 
talking about a particular subject, sitting, etc., may be 
contained in a separate behavior file. In accordance 
with the invention, each behavior file may be down- 
loaded to the client computer only when the behavior is 
required. For example, a behavior to pick up an object 
from the ground for a game player may only be down- 
loaded when the game player nears an object which 
may be picked up. As another example, a behavior to 
say "Good-bye" is only downloaded to the client compu- 
ter when the user clicks on a good-bye button on the 
user interface. Thus, the system may download the 
behavior files asynchronously with the persistent data 
file. Due to the morphlinks in the persistent data, the 
size of the behavior files, as described above, is very 
small. It should be realized, however, that each behavior 
file is associated only with a particular persistent data 
file (since the structure of the behavior and the persist- 
ent storage are tied together) and therefore a walking 
behavior for two separate models will be slightly differ- 
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ent. The behavior files may be generated by the creator 
42 in response to user input The behavior files may be 
compressed in that the data for any joints which do not 
move during a predetermined time during the behavior 
is not downloaded to the client computer. 5 
[0019] Once the behavior and persistent data files 
are generated, they may be downloaded to the server 
44 and stored in a character and behavior storage 
device 62 which may be a persistent storage device 
such as a hard disk drive, a tape drive or the like. The io 
server 44 may also include a player store 64 which con- 
tains a player web file. The player web file is the soft- 
ware application which is first downloaded to the client 
computer so that the client computer may then inter- 
prets the persistent data file as well as the behavior 75 
files. Thus, the server 44 may first download the player 
software application to the client computer (if neces- 
sary) and then, based on user input into a Web user 
interface application 66, download to persistent data file 
so that the animation may begin. Then, as behaviors of 20 
to three dimensional animation are needed by the client 
computer, the server may download the appropriate 
behavior file to be executed by the player on to client" " 
computer. 

[0020J Each client computer 46 may include a CPU 25 
68, a memory 70 containing one or more software appli- 
cation to be executed by to CPU 68, a character cache 
74 which may reside on a persistent storage device of to 
client computer and a display 76. The character cache 
74 may store the persistent data 58 when it is down- 30 
loaded to to client computer the first time so that it may 
not be necessary to downloaded to persistent data 
again when the particular client computer again wants 
to view the same animation. Unlike conventional anima- 
tion systems in which the character data is stored in to 35 
cache of the browser application so that the character 
data is periodically flushed, to system has its own char- 
acter cache. 

[0021] The memory 70 may store a browser appli- 
cation 78 which permits the client computer to interact 40 
with the server 44 by specifying a uniform resource 
locator (URL) of the server in order to receive the web 
files stored on the server using a hypertext transfer pro- 
tocol (HTTP). The memory may also store to player soft- 
ware application 64 to interpret the persistent data file 45 
and the behavior files and generate the animated 
object, a character file 82 generated from the persistent 
data file, a first behavior file 84 containing the idle 
behavior and a second behavior file 86 that may contain 
a behavior that will be executed soon. Thus, the charac- so 
ter file and the current behavior files are both stored in 
the memory 70 while being executed by the player. As 
new behaviors are needed, those behaviors are down- 
loaded to the client computer and one of the old behav- 
iors may be deleted to make room from the new 55 
behavior. The number of behaviors stored in the client 
computer at anytime depends on the amount of mem- 
ory space available for the animation system. The ani- 



mation generated by the player 64 based on the 
persistent data and the behavior files may be displayed 
on the display 76. Now, a method for downloading three 
dimensional character files in accordance with the 
invention will be described. 

[0022] Figure 2 is a flowchart illustrating a method 
1 00 for downloading three dimensional character files to 
a particular client computer in accordance with the 
invention. The downloading method permits the anima- 
tion to begin rapidly since the downloading time is 
reduced due to the asynchronous download of the 
behavior files and the persistent data file. In step 102, 
the server may determine if the player application has 
previously been downloaded to the client computer and 
may downloads the player software in step 104 if it has 
not already been downloaded. Once the player is down- 
loaded to the client computer, the server may download 
the persistent data file (that may include the character 
file and an idle behavior file) to the client computer in 
step 106. The client computer may then create a char- 
acter cache if one does not exist and store the character 
file and the idle behavior file in the character cache. 
Next, the player application is executed by the client 
computer and the player application may use the per- 
sistent data to animate the character and execute the 
Idle behavior in step 108. In accordance with the Inven- 
tion, all of the behaviors for an animated object do not 
need to be initially downloaded so that the download 
time for the persistent data is reduced and the anima- 
tion may begin more quickly. Next, the player application 
may determine if a new behavior for the animated object 
is needed in step 110 and continue to execute the idle 
behavior in step 112 if no new behavior is needed. If a 
new behavior is needed, then the server may download 
the new behavior in step 1 14 in response to a request 
by the player application. The player application may 
then determine if the new behavior has finished down- 
loading in step 116 and continue to execute the prior 
behavior until the new behavior is downloaded. If the 
new behavior is downloaded, then the player may exe- 
cute the new behavior in step 118 and return to step 
1 08. In accordance with the invention, the behaviors are 
downloaded to the client computer as they are needed 
so that the start time of the animation is reduced. In 
addition, since the size of the behavior files is small due 
to the morphlinks, the total download time for any 
behavior file is also short. Now, an example of the object 
hierarchy in the three dimensional animation system will 
be described. 

[0023] Figure 3 is a diagram illustrating an example 
of an object hierarchy 130 in accordance with the inven- 
tion. As shown, the object hierarchy may include a tree 
of objects organized underneath a root node 132. The 
objects used in the three dimensional animation system 
may include a texture object 134, a sound object 136, a 
geometry object 138 and a behavior object 140. Each of 
these objects may then include sub-objects as shown 
for the geometry and behavior objects. In particular, the 
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geometry object 138 may include a polygon object 142 
containing the polygons associated with a particular 
model, a morphlinks object 144 containing the 
morphlinks associated with each polygon in the model, 
a particle system object 146 for storing smaller objects 5 
such as rocket ship exhaust and a camera object 148 for 
storing information about the camera position and angle 
with respect to the model. The geometry may further 
include additional information about the model as 
shown in Figure 4B. 7 o 
[0024] The behavior object 140 may include a 
transform object 150 containing movement information 
for the joints of an object to transform the object, a tex- 
ture track object 152 containing an animated texture of 
a model, a sound object 154 containing a sound track 75 
associated with a behavior and a script object 156 con- 
taining a sequence of behaviors combined together to 
form a new behavior. For example, a script may be for 
interacting with the animated character and may include 
a behavior for each response that the character makes 20 
to the user in response to user input. Each animated 
object may include one or more of the above objects. 
Now, an example of the object for a particular charac- 
ter/model will be described. 

[0025] Figures 4A and 4B are diagrams illustrating 25 
an example of a character object and a three dimen- 
sional object associated with that object in accordance 
with the invention. Figure 4A is a diagram illustrating a 
geometry object 1 60 for a human character in which the 
object models the joints of the character. For example, 30 
the object shown includes a head, a neck, two elbows, 
two wrists, hips, two knees and two ankle joints. As 
described above, the movement of a character is speci- 
fied by the movement of the joints of the character which 
may then be turned into movement of the polygons on 35 
the model based on the morphlinks. A three dimen- 
sional object tree 1 62, as shown in Figure 4B, which 
models this human character has a similar structure. In 
particular, the object tree 162 may include a WORLD 
node connected to a CAMERA node and a BODY node. 40 
The BODY node may further include various objects 
modeling the various joints in the body. As shown, the 
BODY node may include a HIP JOINT node, a LFT 
KNEE object and a RT KNEE object connected to the 
HIP JOINT node and a LFT ANKLE and RT ANKLE 45 
node connected to the appropriate knee nodes. Each 
object in the object tree that is connected to an object 
above it in the tree inherits the attributes of the object 
above it. For example, any movement of the LFT KNEE 
object may cause the LFT ANKLE object to inherit the so 
same movement. This inheritance of the knee move- 
ment by the ankle provides a good model of the human 
body. Similarly, if the HIP JOINT object moves, both of 
knee objects and both of the ankle objects inherit the 
movement of the HIP JOINT object. Therefore, once the 55 
movement of the HIP JOINT object is specified in a 
behavior, the movements .of the knees and ankles 
caused by the HIP JOINT movement do not need to be 



specified. Now, the articulation of a joint in accordance 
with the invention will be described. 
[0026] Figure 5 is a diagram illustrating an example 
of the articulation of joints of a character. In particular, 
an arm 170 of a three dimensional character is shown 
for illustration purposes. The arm may include a shoul- 
der joint 172, an elbow joint 174, a wrist joint 176, an 
upper arm 178, a lower arm 180 and a hand 182. Simi- 
lar to a human arm, each joint has six degrees of free- 
dom since each joint may move in a positive or negative 
X direction, a positive or negative Y direction and/or in a 
positive or negative Z direction. For each predetermined 
period of time referred to as a key period, each joint may 
move in each of the six directions. The key period may 
preferably be 1/1 0th of a second and the player may 
interpolate the movement of the joint in each direction in 
between the key period to ensure that the motion of the 
joint is smooth. The key period may be set by the user. 
As each joint moves, the part of the body near that joint 
may also move. In a three dimensional animation char- 
acter in accordance with the invention, the synchroniza- 
tion of the movement of the body part and the polygons 
which make up the "skin" of the body part with the joints 
of the character are accomplished by the morphlinks in 
accordance with the invention that will now be 
described in more detail. 

[0027] Figure 6 is a diagram illustrating a morphlink 
in accordance with the invention for the upper arm 178 
shown in Figure 5. In this example, the polygons cover- 
ing the upper arm may be influenced by both the shoul- 
der joint 172 and the elbow joint 174. For this example, 
the movement of a polygon 184 on the outside of the 
upper arm based on the movement of the shoulder joint 
and the elbow joint will be described. If the movement of 
the polygon 184 is influenced only by the shoulder 
joint's movement, the polygon 1 84 may move to position 
x v If the movement of the polygon 184 is influenced 
only by the movement of the elbow joint, the polygon 
may move to position x 2 . To realistically model the 
movement of the polygon, however, neither of the above 
positions is accurate and would be perceived by the 
user viewing the animated character as an aberration. 
Therefore, the polygon 184 should be influenced by 
both the shoulder joint and the elbow joint so that the 
polygon 184 moves to position x 3 when the influence of 
both joints are used. In accordance with the invention, 
the relationship of each polygon on the character to the 
joints in the character may be stored in the morphlink 
data which is stored with the persistent data file. The 
morphlink data permits a behavior file to only specify 
the movement of the joints in the character (a small 
amount of data) and then the player application on the 
client computer may determine the movement of each 
polygon of the character based on the morphlink data. 
The actual influence areas of each joint on particular 
polygons on the three dimensional object is controlled 
by the user during the creation of the three dimensional 
character so that once the character is created, each 
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polygon on the character has a fixed movement rela- 
tionship with respect to the joints of the character. Now, 
an example of the area of influence of a joint will be pro- 
vided. 

[0028] Figure 7 is a diagram illustrating an example 
of the area of influence of a joint in accordance with the 
invention. In this example, a joint 190 may have an inner 
area of influence 192 and an outer area of influence 
1 94. A body part 1 96 surrounding the joint 1 90 is shown 
by the dotted lines. For polygons on the body part within 
the inner area of influence 1 92, the joint 1 90 contributes 
100% of its movement to the movement of those poly- 
gons. In this example, the movement of polygons A and 
B have 1 00% contribution from the joint 190 so that, for 
example, if joint 190 moves 1 " in the positive X direction, 
then polygons A and B also move 1" in the positive X 
direction. Then, if another joint moves 1" in the Y direc- 
tion and also contributes 100% to the movement of pol- 
ygons A and B, polygons A and B also move 1 " in the Y 
direction in addition to the movement in the X direction. 
For polygons in the outer area of influence 194, the 
amount of influence on the particular polygon 
decreases as the polygon is located farther away from 
the joint Thus, at the periphery between the inner and 
outer areas of influence, the contribution is still 100% 
while the contribution for a polygon at the outside edge 
of the outer area of influence is 0%. Thus, for polygon C 
in this example, the joint contributes 50% to the move- 
ment of polygon C so that if the joint moves 1" in the 
positive X direction, polygon C moves 1/2" in the posi- 
tive X direction. For polygons D and E in this example, 
the joint 190 contributes 0% movement so that the 
movement of the joint does not affect those polygons. 
Thus, for each polygon on a three dimensional ani- 
mated character, the contributions for each joint in the 
model is set by the user using the creator user interface 
and then stored in the morphlinks by the system in 
accordance with the invention. Now, an example of the 
process forcreating a three dimensional animated char- 
acter in accordance with the invention using the creator 
will be described. 

[0029] Figures 8A and 8B are diagrams illustrating 
an example of the bones within a model in accordance 
with the invention. The bones in the model are gener- 
ated using a user interface 200 in the creator applica- 
tion. The user interface 200 may include an object 
window 202 which lists the objects, such as the geome- 
try and materials (textures) associated with the particu- 
lar three dimensional character being generated. The 
user interface 200 may also include a geometry window 
204 which lists all of the geometry associated with the 
particular three dimensional character such as the neck, 
the left shoulder (ShouldL), the left upper leg (UpLegl) 
and the like. To help the person creating the character, 
the geometry is listed in object order so that the associ- 
ations of objects with other objects and the attributions 
of the characteristics (such as the association of the 
upper left arm with the left shoulder) may be viewed by 



glancing at the geometry window. The geometry win- 
dow also permits the user to make certain portions of 
the character invisible, if desired. The user interface 200 
may also include a three dimensional character viewing 

5 window 206 which shows the user the current view of 
the character. In this example, only one or more bones 
of the character 208 and one or more joints 210 are 
shown by clicking the appropriate locations in the geom- 
etry window. The bones and joints of the three dimen- 

jo sional model may be generated by the creator 
application or by a well known third party piece of soft- 
ware. Once the bones of the character have been laid 
out and set by the user, the user may place a "skin" of 
polygons over the bones as will now be described with 

/ 5 reference to Figure 9. 

[0030] Figures 9 and 1 0 are diagrams illustrating an 
example of a model with the bones and polygons in 
accordance with the invention and an example of a 
character displayed with only the polygons, respectively. 

20 Once again, the user may create the three dimensional 
animated character using the user interface 200 of the 
creator. In this figure, the user has selected to have the 
bones 208 and joints 210 shown in window 206 with a 
polygon skin 212 placed over the bones and joints. The 

25 polygon skin may be generated by the creator applica- 
tion or by a third party piece of software. The polygon 
skin 212 forms the actual surface seen by a person 
when viewing the three dimensional animated character 
and any texture mapped onto these polygons. Figure 1 0 

30 shows the character with just the polygons 212 being 
displayed to the user in the user interface 200. The 
character shown in Figure 10 accurately depicts what 
the three dimensional animated character may look like 
with the exception of a texture being placed on the pol- 

35 ygons. A three dimensional animated character with a 
texture placed on the polygons will now be described 
with reference to Figures 11 and 12. 
[0031] Figure 11 is a diagram illustrating an exam- 
ple of a rendered, unlighted character 220 in accord- 

40 ance with the invention within the viewing window 206 
while Figure 12 is a diagram illustrating an example of a 
rendered, lighted character 230 in accordance with the 
invention. As shown in Figure 1 1 , the three dimensional 
character has been covered with textured polygons so 

45 that, for example, the character has long hair, eyebrows, 
a nose, a mouth with lips and eyes. The textures may be 
generated by a third party piece of software and then 
positioned onto the animated character by the user 
using the creator application. The entire unlighted char- 
so acter 220 is shown in Figure 1 4. 

[0032] In Figure 12, the same character has a 
chrome texture and has been lighted with a particular 
lighting model. To texture the character with the chrome 
surface, a material window 232 may be displayed which 

55 permits the user to select a material/texture. In this 
example shown, the chrome material was selected. The 
material window may include a palette 234 of materials 
which may cover the polygons, such as a body material, 
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a bottom teeth material, a chrome material, a hair mate- 
rial and a top teeth material. The lighting may be applied 
to the character by specifying a lighting model for the 
character. An example of a lighting model will now be 
described with reference to Figure 1 3. 5 
[0033] Figure 13 is a diagram illustrating an exam- 
ple of an environmental map lighting model 240 in 
accordance with the invention which may be applied to 
a three dimensional character such as the one shown in 
Figure 12. The environmental map 240 is generated by 10 
having the selected lighting choice illuminate a surface 
of a sphere. Thus, as shown in Figure 13, the particular 
lighting model causes the sphere's surface to have a 
particular appearance made up of individual pixels hav- 
ing different intensities. To transfer the lighting model 15 
onto a three dimensional character, the appearance of 
the character at a particular location is the same as the 
appearance of the sphere at the same location. For 
example, the left side of the sphere has a bright spot 
242 and the character, shown in Figure 12, also has a 20 
bright spot 244 along the left side of the character. Sim- 
ilarly, the sphere has a light shadow 246 near the top of 
the sphere and the character 230 has a corresponding 
light shadow 248. Thus, in accordance with the inven- 
tion, the lighting model for the character is generated by 25 
looking up the appearance of the lighting model on a 
particular location on a sphere and then mapping the 
sphere's lighting at the particular location onto the poly- 
gons of the animated character at the same particular 
location. In accordance with the invention, it is not nec- 30 
essary to calculate the lighting for each pixel of the char- 
acter. In a typical three dimensional animation system, 
the lighting model may be transferred onto the character 
by calculating the lighting of each pixel on the character 
which is a slow process. Now, an example of a 35 
morphlink associated with the leg of a character will be 
described. 

[0034] Figures 15 and 16 are diagrams illustrating 
an example of the bones in a leg and the morphlink 
associated with the leg in accordance with the inven- 40 
tion. In particular Figure 16 shows the display window 
206 of the creator with a bottom half 250 of a character. 
In this example, a hip joint 252, a knee joint 254 and an 
ankle joint 256 are shown inside of the character. Each 
pixel of each polygon forming the "skin" of the character 45 
may then have its motion determined by the creator of 
the character by setting the morphlinks that associate a 
particular pixel's movement with the contributions from 
each joint in the character. ' 

[0035] Figure 16 illustrates the user interface 200 so 
with the main window 202, the geometry window 204 
and the display window 206. When viewing the 
morphlinks in the character, the user interface may also 
include a morphlink window 258 which contains a list of 
each polygon in the character along with the contribu- 55 
tions of each joint's movement to the movement of that 
polygon. In this example, the right leg has moved 
upwards and a polygon 260 has been selected. The 



morphlink window 258 may then highlight the selected 
polygon (Body _ Geo Vert 188 in this example) along 
with the contribution from the knee joint which is 77.62% 
in this example. Thus, if the knee moves 10" in the pos- 
itive X direction, the selected polygon moves 7.762" in 
the positive X direction. As described above, each poly- 
gon may be influenced by one or more joints and the 
contributions of each joint are added together to deter- 
mine the movement of that polygon. The morphlink per- 
mits a downloaded behavior files to specify only the 
movement of each joint and then the player on the client 
computer may determine the movement of each poly- 
gon based on the movement of the joints and the 
morphlinks. Now, the areas of influence of a joint will be 
described in more detail using the character shown in 
Figures 15 and 16. 

[0036] Figure 17 is a diagram illustrating the char- 
acter 250 of Figures 15 and 16 showing the area of 
influence for each joint. The areas of influence for each 
joint may include an inner region 270 and an outer 
region 272. During the creation of a character, the user 
of the creator may adjust these inner and outer regions 
which adjusts the influence of that joint. In this example, 
the areas of influence for the hip joint 252, the knee joint 
254 and the ankle joint 256 are shown. The details 
about the areas of influence are described above and 
will not be described here. Now, an example of a behav- 
ior will be described. 

[0037] Figure 18 is a diagram illustrating an exam- 
ple of a behavior 280 in accordance with the invention 
which may be downloaded to a client computer. As 
shown, the structure of the behavior may follow the 
structure of the objects within a character. In particular, 
the behavior may include a root node 282, a dance hips 
node 284 specifying the movement of the hips of the 
character during the dance behavior, a dance-rt. knee 
and dance-lft knee nodes 286, 288 which specify the 
movement of the knees during the dance behavior, etc. 
Thus, the objects in the behavior map to the objects in 
the character since the objects in the behavior specify 
the movement of the objects in the character. In addition 
to the movement, the behavior may also specify a 
sound track associated with the behavior. For most 
behaviors which occur over time, the behavior may be 
broken down into one or more key periods so that the 
movement of each object during the behavior may 
change at each new key period and the system may 
interpolate between the key periods. The behavior may 
also be compressed in that, if an object, such as the 
head, is not moving or the object is not changing its 
movement during the behavior, the object for the head 
may be left out of the behavior file since the player will 
assume that any joint not in a behavior file will do the 
same time that It was doing before. To better understand 
the behavior, an example of an object within the behav- 
ior will be described in more detail. 
[0038] For purposes of illustration, the dance-hips 
object 284 will be described in more detail, although 
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each object in the behavior may have a similar data 
structure even if each object moves in a different man- 
ner. Thus, for each key period (shown in Figure 18 as 
0.1 second intervals), the object 284 may specify the 
movement of the object in the three dimensions (X.Y.Z). 
As shown, the movement in each dimension may 
change during each key period. Between the key peri- 
ods, the player may use interpolation to ensure a 
smooth movement Another example of a behavior will 
now be described. 

[0039] Figures 19A, 19B and 19C are diagrams 
illustrating another example of a behavior in accordance 
with the invention, in this example, the behavior is hav- 
ing a character's mouth form the syllable "Ah" and a cor- 
responding sound track being played to simulate the 
character speaking the syllable "Ah". Figure 1 9A shows 
a structure 290 for the behavior which may include one 
or more time frames 292 to ensure synchronization of 
the character with the behavior at each key period. Fol- 
lowing each time frame is the data about the movement 
of each object in the character during that key period 
including the position change of each object, the orien- 
tation change of each object and the scale change of 
each object. Figure 19B illustrates a behavior object 
294 for the "Ah" behavior including links to each object 
(joint) In the mouth that is moved during the behavior. 
Figure 1 9C illustrates a sound track 296 associated with 
the "Ah" behavior. In accordance with the invention, a 
behavior may also include a plurality of behaviors which 
may be selected based on various factors including a 
user's actions. Thus, the invention permits a class of 
behaviors to be downloaded to the player at one time. 
Now, a method for streaming behaviors in accordance 
with the invention will be described. 
[0040] In accordance with the invention, it is desira- 
ble to being the animation of the animated character 
including its behaviors as soon as possible so that the 
user of the player application may begin viewing the ani- 
mation as soon as possible. When a large behavior file 
needs to be downloaded to the player application, it is 
possible with conventional animation systems that the 
animation of the animated character is delayed which is 
not acceptable. For example, if a behavior contains a 
sound track, the sound data may be large enough that 
the behavior takes as long to download as it does to 
play. On a modem that transmits 28,800 bit per second, 
even compressed sound data requires 13,000 bit per 
second to download the sound data and the behavior 
key frames require the rest of the bandwidth. It is not 
reasonable to make a user wait five minutes for the five 
minute long behavior to download before it is played. In 
accordance with the invention, the animation system 
and in particular the player application may start playing 
a behavior while the behavior Is still being downloaded 
to the player application which may be known as behav- 
ior streaming. 

[0041] Figure 20 is a flowchart illustrating a method 
300 for streaming behaviors in accordance with the 



invention. In step 302, the user may select a behavior 
and/or start the execution of a behavior by, for example, 
clicking on a button or an icon on a Web page. In step 
304, the player application determines if the behavior is 

5 a streaming behavior since each behavior associated 
with an animated character may be identified as a 
streaming behavior or not. A behavior may be identified 
as a streaming behavior when the behavior requires 
more than a predetermined download time, such as 

10 when the behavior includes sound data. If the behavior 
is not a streaming behavior, the method is completed. If 
the behavior is a streaming behavior, the player applica- 
tion may download the behavior objects, as described 
below, in step 306 and downloads the first predeter- 

75 mined sized chunk of the behavior data in step 308. In a 
preferred embodiment, the chunk of behavior data may 
be sufficient data for ten seconds of the behavior. The 
rest of the behavior data may be downloaded asynchro- 
nously as the player application is executing the previ- 

20 ously downloaded chunk of the behavior data. For a 
behavior that lasts a total of five minutes, the streaming 
behavior beings playing after only ten seconds and the 
rest of the behavior data may be downloaded as the 
behavior is being executed. In accordance with the 

25 invention, the chunk being downloaded to the player 
application may always be a predetermined number of 
seconds (ten seconds in a preferred embodiment) 
ahead of the currently playing portion of the behavior. 
[0042] In a preferred embodiment, the predeter- 

30 mined chunk of behavior data downloaded before start- 
ing the behavior may be ten seconds of behavior time. 
The downloading of the rest of the streaming behavior 
data may also be ten seconds ahead of the currently 
playing behavior data. The ten second time takes into 

35 account that the Internet sometimes suffers congestion 
and therefore is delayed is delivering the behavior data. 
If the player application started playing the streaming 
behavior as soon as it was downloaded, the user may 
experience interruptions in the animation. Thus, the ten 

40 second interval provides a buffer of data so that the sys- 
tem has some ability to compensate for when the Inter- 
net is congested. For the streaming of the behavior data 
to work, the behavior data must be compressed so that 
behavior data may be downloaded from the Internet at 

45 least as fast as the player application plays the behavior 
data. For example, if the user uses a modem to down- 
load the behavior data, the behavior data is highly com- 
pressed so that it requires less than one second to 
download one second worth of behavior data. 

so [0043] Returning to the flowchart, after the initial 
chunk of behavior data is downloaded, the player appli- 
cation may execute the behavior in step 310. While the 
initial chunk of behavior is being executed, the player 
application may determine if the downloaded behavior 

55 data is more than a predetermined number of seconds 
(twenty seconds in a preferred embodiment) ahead of 
the behavior data currently being played in step 312. If 
the downloaded behavior data is more than twenty sec- 
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onds ahead of the currently played behavior data, the 
player application may stop further downloads in step 
314 until the new behavior data is less than a predeter- 
mined time (ten seconds in a preferred embodiment) 
ahead of the currently playing behavior data. Then, in 
step 316, the player application may download the next 
chunk of behavior data. In step 318, the player applica- 
tion may determine if there is more behavior data to 
download and either loop back to step 308 to download 
a next chunk of behavior data or complete the method if 
there is no more behavior data to be downloaded. Now, 
the streaming behavior files in accordance with the 
invention will be described. 

[0044] Figure 21 is a diagram illustrating a stream 
file 330 in accordance with the invention. In particular, 
the creator described above, may generate special files 
for streaming behaviors known as stream files. The 
stream files 330 may include behavior objects 332 and 
one or more chunks of key frame and sound data 334. 
The behavior objects may include all of the data that 
describes the components of the behavior, such as the 
geometry and the movement of each joint in the ani- 
mated character during the behavior. The behavior 
objects does not contain any key frames of behavior 
data, such as sound data. Each of the one or more 
chunks of behavior data 334 may contain a predeter- 
mined amount of behavior data (such as two seconds of 
behavior data in a preferred embodiment). For example, 
the first chunk of behavior data may contain all of the 
key frames from all of the behavior tracks which occur 
during the first predetermined time interval along with 
the sound data that plays during the first predetermined 
time interval of the behavior. Each chunk of behavior 
data starts at the same time as the corresponding time 
in the behavior so that the initial chunk starts at the start 
of the behavior. Now, an example of the structure for 
each chunk of behavior data will be described. 
[0045] Figure 22 is a diagram illustrating an exam- 
ple of the structure of each chunk of behavior data 334. 
Each chunk 334 may be divided into one or more tracks 
336 wherein each track contains data about a particular 
portion of the animated character. In this example, there 
is a head track 338, a torso track 340 and a knee track 
342 as shown in Figure 22 which are respectively asso- 
ciated with the head, torso and knee of the animated 
character geometry. As shown, the chunk also include 
the sound data 344 for that particular portion of the 
behavior data. 

[0046] Figure 23 is a diagram illustrating more 
details of the chunk 334 of behavior data. In particular, 
the chunk of behavior data includes the tracks 338, 340 
and a timestamp 350. The timestamp may indicate the 
time of the chunk within the behavior, such as that the 
chuck covers time t to time t+2 seconds of the behavior. 
Each track 338, 340 may include an identifier 352 that 
identifies the behavior object with which the particular 
track is associated, a length of data field 354 (len) indi- 
cating that length of the data in the track and a data field 



S9 614A2 20 

356 containing the keyframe and behavior data for that 
track. Each chunk 334 may end with a track identifica- 
tion of zero (id-0) indicating the end of the particular 
chunk of behavior data. Now, the operation of the player 

5 will be described. 

[0047] Figures 24 and 25 are flowcharts illustrating 
the operation of the player in accordance with the inven- 
tion. Figure 24 is a flowchart illustrating the operation 
400 of the player for each frame of images being dis- 

w played to the user of the client computer. In step 402, 
the player may read any user inputs and react according 
to those user inputs. Next, the player may determine 
any geometry changes in the character in step 404 
based on any currently executing behaviors. Next, the 

is player may generate the polygons of the character in 
step 406 based on the above determined changes in 
the geometry and the morphlinks as described above. 
Once the polygons are generated, the data about the 
polygons of the character may be scan converted in 

20 step 408 so that the character and the polygons may be 
displayed on a display screen. In step 410, the charac- 
ter may be transferred to the display memory, such as 
by using a well known BLTBLK routine, so that it may be 
displayed to the user. Now, the details about determin- 
es ing the geometry changes will be described. 

[0048] Rgure 25 is a flowchart illustrating a method 
420 for determining geometry changes in accordance 
with the invention. In step 422, the player may call any 
update scripts which may include commands about the 

30 current behavior being executed. If there are no other 
behaviors being executed, the player may execute the 
idle behavior. In step 424, the player may determine if 
the update scripts contain any new behaviors and 
request the download of the new behavior in step 426 if 

35 a new behavior is needed. Next, in step 428, the player 
determines the geometry changes for the character 
based on the currently executing behavior. 
[0049] While the foregoing has been with reference 
to a particular embodiment of the invention, it will be 

40 appreciated by those skilled in the art that changes in 
this embodiment may be made without departing from 
the principles and spirit of the invention. 

Claims 

45 

1. A system for animating a character on a computer, 
comprising: 

a first computer for storing one or more pieces 
so of data associated with a particular animated 

character, the pieces of data including a per- 
sistent data file containing one or more of a 
geometric model of the animated character, a 
texture associated with the animated character 
55 and a sound associated with the animated 

character, the pieces of data further comprising 
one or more behavior files, each behavior file 
containing data about a particular behavior of 
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the animated character, each behavior specify- 
ing the movement of the model; and 

a second computer connected to the first com- 
puter by a communications network, the sec- s 
ond computer further comprising means for 
initially downloading the persistent data file 
from the server computer in order to begin the 
animation of the animated character and 
means for asynchronously downloading a w 
behavior file from the first computer just prior to 
the execution of the behavior of the animated 
character by the second computer. 

2. The system of Claim 1 , wherein the persistent data 15 
further comprises an idle behavior for the animated 
character, the idle behavior being executed when 
there is no other behavior being executed by the 
second computer for the animated character. 

20 

3. The system of Claim 1 , wherein the second compu- 
ter further comprises a persistent storage device 
that includes a character cache that stores the per- 
sistent data about that animated character so that 

the persistent data is still resident on the second 25 
computer after the animation has been completed. 

4. The system of Claim 1, wherein the geometric 
model further comprises one or more joints linked 
together by one or more bones and a plurality of 30 
polygons forming a skin over the joints and bones 
and wherein the persistent data further comprises a 
morphlink for each polygon on the animated char- 
acter, each morphlink comprising an association of 

the movement of the polygon to the movement of 35 
one or more joints in the geometric model so that 
the movement of the polygon is determined based 
on the movement of the one or more joints. 

5. The system of Claim 4, wherein the morphlink fur- 40 
ther comprises a contribution value for each joint 
that affects the polygon wherein the contribution 
values for all of the joint that affect the polygon are 
added together to determine the movement of the 
polygon. 45 

6. The system of Claim 5, wherein each joint in the 
geometric model further comprises an inner area of 
influence surrounding the joint and an outer area of 
influence surrounding the inner area of influence so 
wherein the movement of the polygons within the 
inner area of influence is similar to the movement of 
the joint, the movement of the polygons outside of 
the Inner area of influence but inside the outer area 

of influence is less than the movement of the joint 55 
and the movement of polygons outside of the outer 
area of influence is not affected by the movement of 
the joint. 



7. The system of Claim 6, wherein polygons in the 
outer area of influence are affected increasingly 
less by the movement of the joint as the polygon is 
located farther away from the joint. 

8. The system of Claim 1 , wherein to persistent data 
further comprises a lighting environmental map for 
to animated character, to lighting environmental 
map comprising a lighting model illuminated onto a 
surface of a sphere so that the lighting on each pol- 
ygon in a particular location on the animated char- 
acter is looked up from the corresponding location 
on to sphere. 

9. The system of Claim 4, wherein the geometric 
model comprises an object representing each joint 
of the animated character and wherein the behavior 
files comprises an object for each joint containing 
data about the movement of each joint during a par- 
ticular behavior, the polygons of the animated char- 
acter moving based on the behavior file and the 
morphlinks. 

10. The system of Claim 9, wherein the behavior file 
further comprises one or more key periods during 
the behavior wherein each joint is able to move dur- 
ing each key period. 

11. The system of Claim 10, wherein the behavior file 
further comprises a sound track associated with the 
behavior, the sound track being synchronized to the 
one or more key periods. 

12. The system of Claim 9, wherein the behavior file 
further comprises a plurality of individual behaviors 
associated with the animated character and means, 
based on predetermined input, for selecting one of 
the individual behaviors to be executed for the ani- 
mated character. 

13. The system of Claim 1, wherein each behavior file 
further comprises a stream file containing behavior 
data about a streaming behavior and wherein the 
second computer further comprises means for 
streaming the stream file from the first computer so 
that the behavior associated with the stream file is 
executed before the entire stream file is down- 
loaded to the second computer. 

14. The system of Claim 13, wherein the streaming 
means further comprises means for downloading a 
behavior object and a predetermined portion of the 
stream file when the behavior is selected, means, 
while the behavior is executing, for downloading 
one or more other predetermined portions of the 
stream file. 

15. The system of Claim 14, wherein the streaming 



12 



23 



EP1 059 614 A2 



24 



means further comprises means for halting the 
downloading of the stream file when the behavior 
data being downloaded is more than a predeter- 
mined number of seconds ahead of the behavior 
data being executed. 

16. A method for animating a character on a computer, 
comprising: 

storing one or more pieces of data associated 
with a particular animated character on a first 
computer, the pieces of data including a per- 
sistent data file containing one or more of a 
geometric model of the animated character, a 
texture associated with the animated character 
and a sound associated with the animated 
character, the pieces of data further comprising 
one or more behavior files, each behavior file 
containing data about a particular behavior of 
the animated character, each behavior specify- 
ing the movement of the model; 
initially downloading the persistent data file 
from the first computer to a second computer 
over a communications network so that the ani- 
mation of the animated character begins on the 
second computer; and 

asynchronously downloading a behavior file 
from the first computer to the second computer 
just prior to the execution of the behavior of the 
animated character by the second computer. 

17. The method of Claim 16, wherein the persistent 
data further comprises an idle behavior for the ani- 
mated character, the idle behavior being executed 
when there Is no other behavior being executed by 
the second computer for the animated character. 

18. The method of Claim 16 further comprising storing 
the persistent data in the second computer using a 
persistent storage device so that the persistent data 
is still resident on the second computer after the 
animation has been completed. 

19. The method of Claim 16, wherein the geometric 
model further comprises one or more joints linked 
together by one or more bones and a plurality of 
polygons forming a skin over the joints and bones 
and wherein the persistent data further comprises a 
morphlink for each polygon on the animated char- 
acter, each morphlink comprising an association of 
the movement of the polygon to the movement of 
one or more joints in the geometric model so that 
the movement of the polygon is determined based 
on the movement of the one or more joints. 

20. The method of Claim 1 9, wherein the morphlink fur- 
ther comprises a contribution value for each joint 
that affects the polygon wherein the contribution 



values for all of the joint that affect the polygon are 
added together to determine the movement of the 
polygon. 

5 21. The method of Claim 20, wherein each joint in the 
geometric model further comprises an inner area of 
influence surrounding the joint and an outer area of 
influence surrounding the inner area of influence 
wherein the movement of the polygons within the 

10 inner area of influence is similar to the movement of 
the joint, the movement of the polygons outside of 
the inner area of influence but inside the outer area 
of influence is less than the movement of the joint 
and the movement of polygons outside of the outer 

is area of influence is not affected by the movement of 
the joint. 

22. The method of Claim 21 , wherein polygons in the 
outer area of influence are affected increasingly 

20 less by the movement of the joint as the polygon is 
located farther away from the joint. 

23. The method of Claim 16, wherein the persistent 
data further comprises a lighting environmental 

25 map for the animated character, the lighting envi- 
ronmental map comprising a lighting model Illumi- 
nated onto a surface of a sphere so that the lighting 
on each polygon in a particular location on the ani- 
mated character is looked up from the correspond- 

30 ing location on the sphere. 



24. The method of Claim 19, wherein the geometric 
model comprises an object representing each joint 
of the animated character and wherein the behavior 
files comprises an object for each joint containing 
data about the movement of each joint during a par- 
ticular behavior, the polygons of the animated char- 
acter moving based on the behavior file and the 
morphlinks. 

25. The method of Claim 24, wherein the behavior file 
further comprises one or more key periods during 
the behavior wherein each joint is able to move dur- 
ing each key period. 

26. The method of Claim 25, wherein the behavior file 
further comprises a sound track associated with the 
behavior, the sound track being synchronized to the 
one or more key periods. 



35 



40 



45 



50 



27. The system of Claim 24, wherein the behavior file 
further comprises a plurality of individual behaviors 
associated with the animated character and means, 
based on predetermined input, for selecting one of 

55 the individual behaviors to be executed for the ani- 
mated character. 

28. The method of Claim 16, wherein each behavior file 
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further comprises a stream file containing behavior 
data about a streaming behavior and further com- 
prising streaming the stream file from the first com- 
puter to the second computer so that the behavior 
associated with the stream file is executed before 
the entire stream file is downloaded to the second 
computer. 

29. The method of Claim 2B, wherein the streaming fur- 
ther comprises downloading a behavior object and 
a predetermined portion of the stream file when the 
behavior is selected, and, while the behavior is exe- 
cuting, downloading one or more other predeter- 
mined portions of the stream file. 

30. The method of Claim 29, wherein the streaming fur- 
ther comprises halting the downloading of the 
stream file when the behavior data being down- 
loaded is more than a predetermined number of 
seconds ahead of the behavior data being exe- 
cuted. 

31. An apparatus for animating a character on a com- 
puter based on animation data contained on 
another remote computer, the apparatus compris- 
ing: 

means for communicating with the remote 
computer in order to download the animation 
data from the remote computer, the animation 
data comprising a persistent data file contain- 
ing one or more of a geometric model of the 
animated character, a texture associated with 
the animated character and a sound associ- 
ated with the animated character, the pieces of 
data further comprising one or more behavior 
files, each behavior file containing data about a 
particular behavior of the animated character, 
each behavior specifying the movement of the 
model; 

means for initially downloading the persistent 
data file from the remote computer in order to 
begin the animation of the animated character 
on the computer; and 

means for asynchronously downloading a 
behavior file from the remote computer just 
prior to the execution o( the behavior of the ani- 
mated character by the computer. 

32. The apparatus of Claim 31, wherein the persistent 
data further comprises an idle behavior for the ani- 
mated character, the Idle behavior being executed 
when there is no other behavior being executed by 
the second computer for the animated character. 

33. The apparatus of Claim 31, wherein the computer 



further comprises a persistent storage device that 
includes a character cache that stores the persist- 
ent data about that animated character so that the 
persistent data is still resident on the computer after 
5 the animation has been completed. 

34. The apparatus of Claim 31, wherein the geometric 
model further comprises one or more joints linked 
together by one or more bones and a plurality of 

10 polygons forming a skin over the joints and bones 
and wherein the persistent data further comprises a 
morphlink for each polygon on the animated char- 
acter, each morphlink comprising an association of 
the movement of the polygon to the movement of 

15 one or more joints in the geometric model so that 
the movement of the polygon is determined based 
on the movement of the one or more joints. 

35. The apparatus of Claim 34, wherein the morphlink 
20 further comprises a contribution value for each joint 

that affects the polygon wherein the contribution 
values for all of the joint that affect the polygon are 
added together to determine the movement of the 
polygon. 

25 

36. The apparatus of Claim 35, wherein each joint In 
the geometric model further comprises an inner 
area of influence surrounding the joint and an outer 
area of influence surrounding the inner area of influ- 

30 ence wherein the movement of the polygons within 
the inner area of influence is similar to the move- 
ment of the joint, the movement of the polygons 
outside of the inner area of influence but inside the 
outer area of influence is less than the movement of 

35 the joint and the movement of polygons outside of 
the outer area of influence is not affected by the 
movement of the joint. 

37. The apparatus of Claim 36, wherein polygons in the 
40 outer area of influence are affected increasingly 

less by the movement of the joint as the polygon is 
located further away from the joint. 

38. The apparatus of Claim 31, wherein the persistent 
45 data further comprises a lighting environmental 

map for the animated character, the lighting envi- 
ronmental map comprising a lighting model illumi- 
nated onto a surface of a sphere so that the lighting 
on each polygon in a particular location on the ani- 
50 mated character is looked up from the correspond- 
ing location on the sphere. 

39. The apparatus of Claim 34, wherein the geometric 
model comprises an object representing each Joint 

55 of the animated character and wherein the behavior 
files comprises an object for each joint containing 
data about the movement of each joint during a par- 
ticular behavior, the polygons of the animated char- 
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acter moving based on the behavior file and the 
morphlinks. 

40. The apparatus of Claim 39, wherein the behavior 
file further comprises one or more key periods dur- 
ing the behavior wherein each joint is able to move 
during each key period. 

41. The apparatus of Claim 40, wherein the behavior 
file further comprises a sound track associated with 
the behavior, the sound track being synchronized to 
the one or more key periods. 

42. The apparatus of Claim 39, wherein the behavior 
file further comprises a plurality of individual behav- 
iors associated with the animated character and 
means, based on predetermined input, for selecting 
one of the individual behaviors to be executed for 
the animated character. 

43. The apparatus of Claim 31 , wherein each behavior 
file further comprises a stream file containing 
behavior data about a streaming behavior and 
wherein the second computer further comprises 
means for streaming the stream file from the first 
computer so that the behavior associated with the 
stream file is executed before the entire stream file 
is downloaded to the second computer. 

44. The apparatus of Claim 43, wherein the streaming 
means further comprises means for downloading a 
behavior object and a predetermined portion of the 
stream file when the behavior is selected, means, 
while the behavior is executing, for downloading 
one or more other predetermined portions of the 
stream file. 

45. The apparatus of Claim 44, wherein the streaming 
means further comprises means for halting the 
downloading of the stream file when the behavior 
data being downloaded is more than a predeter- 
mined number of seconds ahead of the behavior 
data being executed. 

46. A server computer for downloading animation files 
to a remote computer connected to the server com- 
puter to animate a character on the remote compu- 
ter, the server comprising: 

means for storing one or more pieces of anima- 
tion data associated with a particular animated 
character, the animation data comprising a per- 
sistent data file containing one or more of a 
geometric model of the animated character, a 
texture associated with the animated character 
and a sound associated with the animated 
character, the pieces of data further comprising 
one or more behavior files, each behavior file 



containing data about a particular behavior of 
the animated character, each behavior specify- 
ing the movement of the model; and 

5 means, in response to a request by the remote 

computer, for initially downloading the persist- 
ent data file to the remote computer in order to 
begin the animation of the animated character 
on the remote computer; and 

70 

means, in response to a request by the remote 
computer, for asynchronously downloading a 
behavior file to the remote computer just prior 
to the execution of the behavior of the animated 
15 character by the remote computer. 

47. The server of Claim 46, wherein the persistent data 
further comprises an idle behavior for the animated 
character, the idle behavior being executed when 

20 there is no other behavior being executed by the 
second computer for the animated character. 

48. The server of Claim 46, wherein the second compu- 
ter further comprises a persistent storage device 

25 that includes a character cache that stores the per- 
sistent data about that animated character so that 
the persistent data is still resident on the second 
computer after the animation has been completed. 

30 49. The server of Claim 46, wherein the geometric 
model further comprises one or more joints linked 
together by one or more bones and a plurality of 
polygons forming a skin over the joints and bones 
and wherein the persistent data further comprises a 

35 morphlink for each polygon on the animated char- 
acter, each morphlink comprising an association of 
the movement of the polygon to the movement of 
one or more joints in the geometric model so that 
the movement of the polygon is determined based 

40 on the movement of the one or more joints. 

50. The server of Claim 49, wherein the morphlink fur- 
ther comprises a contribution value for each joint 
that affects the polygon wherein the contribution 

45 values for all of the joint that affect the polygon are 
added together to determine the movement of the 
polygon. 

51. The server of Claim 50, wherein each joint in the 
so geometric model further comprises an inner area of 

Influence surrounding the joint and an outer area of 
influence surrounding the inner area of influence 
wherein the movement of the polygons within the 
inner area of Influence is similar to the movement of 
55 the joint, the movement of the polygons outside of 
the inner area of influence but inside the outer area 
of influence is less than the movement of the joint 
and the movement of polygons outside of the outer 
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area of influence is not affected by the movement of 
the joint. 

52. The server of Claim 51 , wherein polygons in the 
outer area of influence are affected increasingly 5 
less by the movement of the joint as the polygon is 
located farther away from the joint. 

53. The server of Claim 46, wherein the persistent data 
further comprises a lighting environmental map for w 
the animated character, the lighting environmental 
map comprising a lighting model illuminated onto a 
surface of a sphere so that the lighting on each pol- 
ygon in a particular location on the animated char- 
acter is looked up from the corresponding location 15 
on the sphere. 

54. The server of Claim 49, wherein the geometric 
model comprises an object representing each joint 

of the animated character and wherein the behavior 20 
files comprises an object for each joint containing 
data about the movement of each joint during a par- 
ticular behavior, the polygons of the animated char- 
acter moving based on the behavior file and the 
morphlinks. 25 

55. The server of Claim 54, wherein the behavior file 
further comprises one or more key periods during 
the behavior wherein each joint is able to move dur- 
ing each key period. 30 



movement of the one or more joints; and 

one or more behavior files, each behavior file 
containing data about a particular behavior of 
the animated character and specifying the 
movement of one or more joints in the ani- 
mated character during the behavior wherein 
the movement of the polygons on the animated 
character during a behavior are determined by 
the behavior file and the morphlinks. 

59. The system of Claim 58, wherein the morphlink fur- 
ther comprises a contribution value for each joint 
that affects the polygon wherein the contribution 
values for alt of the joint that affect the polygon are 
added together to determine the movement of the 
polygon. 

60. The system of Claim 59, wherein each joint in the 
geometric model further comprises an inner area of 
influence surrounding the joint and an outer area of 
influence surrounding the inner area of influence 
wherein the movement of the polygons within the 
inner area of influence is similar to the movement of 
the joint, the movement of the polygons outside of 
the inner area of Influence but inside the outer area 
of influence is less than the movement of the joint 
and the movement of polygons outside of the outer 
area of influence is not affected by the movement of 
the joint. 



56. The server of Claim 55, wherein the behavior file 61. 
further comprises a sound track associated with the 
behavior, the sound track being synchronized to the 
one or more key periods. 35 



The system of Claim 60, wherein polygons in the 
outer area of influence are affected increasingly 
less by the movement of the joint as the polygon is 
located farther away from the joint. 



57. The server of Claim 54, wherein the behavior file 
further comprises a plurality of individual behaviors 
associated with the animated character and means, 
based on predetermined input for selecting one of 40 
the individual behaviors to be executed for the ani- 
mated character. 

56. A computer implemented system for generating a 
animated character using animation data, the ani- 45 
mation data comprising: 

a persistent data file containing a geometric 
model of the animated character comprising 
one or more joints linked together by one or 50 
more bones, a plurality of polygons forming a 
skin over the joints and bones of the animated 
character, and a morphlink for each polygon on 
the animated character, each morphlink com- 
prising an association of the movement of the 55 
polygon to the movement of one or more joints 
in the geometric model so that the movement 
of the polygon is determined based on the 



62. A computer implemented system for generating a 
animated character using animation data, the ani- 
mation data comprising: 

a persistent data file containing a geometric 
model of the animated character comprising 
one or more joints linked together by one or 
more bones, a plurality of polygons forming a 
skin over the joints and bones of the animated 
character, and a morphlink for each polygon on 
the animated character, each morphlink com- 
prising an association of the movement of the 
polygon to the movement of one or more joints 
in the geometric model so that the movement 
of the polygon is determined based on the 
movement of the one or more joints; and 
one or more behavior files, each behavior file 
containing data about a particular behavior of 
the animated character and specifying the 
movement of one or more joints in the ani- 
mated character during the behavior wherein 
the movement of the polygons on the animated 
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character during a behavior are determined by 
the behavior file and the morphlinks. 

63. A computer implemented system for generating a 
animated character using animation data, the ani- s 
mation data comprising: 

a persistent data file containing information 
about the animated character including the 
joints in the animated character; and w 
one or more behavior files, each behavior file 
containing data about a particular behavior of 
the animated character and specifying the 
movement of the animated character during 
the behavior, each behavior file comprising is 
behavior objects containing data about the 
movement of the animated character and one 
or more chunks of data associated with prede- 
termined portions of the behavior, each chunk 
comprising one or more tracks containing 20 
behavior data associated with each of joints of 
the animated character. 

64. A system for animating a character on a computer, 
comprising: 25 

a first computer for storing one or more pieces 
of data associated with a particular animated 
character, the pieces of data including a per- 
sistent data file and one or more behavior files, 30 
each behavior file containing data about a par- 
ticular behavior of the animated character com- 
prising behavior objects and one or more 
chunks of data associated with predetermined 
portions of the behavior; and 35 

a second computer connected to the first com- 
puter by a communications network, the sec- 
ond computer further comprising means for 
initially downloading the persistent data file 40 
from the server computer in order to begin the 
animation of the animated character and 
means for downloading a behavior file from the 
first computer just prior to the execution of the 
behavior of the animated character by the sec- 45 
ond computer, the behavior downloading fur- 
ther comprising means for initially downloading 
the behavior objects and a first chunk of the 
behavior data in order to execute the behavior, 
and means, while the behavior is executing, for 50 
asynchronously downloading the other chunks 
of the behavior data 
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